Towards Automating Model Explanations with Certified Robustness Guarantees

نویسندگان

چکیده

Providing model explanations has gained significant popularity recently. In contrast with the traditional feature-level explanations, concept-based can provide in form of high-level human concepts. However, existing explanation methods implicitly follow a two-step procedure that involves intervention. Specifically, they first need to be involved define (or extract) concepts, and then manually compute importance scores these identified concepts post-hoc way. This laborious process requires effort resource expenditure due manual work, which hinders their large-scale deployability. practice, it is challenging automatically generate without intervention subjectivity defining units interpretability. addition, its data-driven nature, interpretability itself also potentially susceptible malicious manipulations. Hence, our goal this paper free from tedious process, while ensuring generated are provably robust adversarial perturbations. We propose novel interpretation method, not only prototype-based concept but certified robustness guarantees for explanations. conduct extensive experiments on real-world datasets verify desirable properties proposed method.

برای دانلود باید عضویت طلایی داشته باشید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Towards Automating Explanations

This paper discusses an approach to the modelling of the explanation process within the framework of a graphics-based CAD system currently under development, which can describe its own use, including the common ways to make and recover from errors. With a coordinated textual and pictorial display, the system, CADHELP, simulates an expert demonstrating the operation of the graphical features of ...

متن کامل

Towards a Certified Petri Net Model-Checker

Petri nets are widely used in the domain of automated verification through model-checking. In this approach, a Petri Net model of the system of interest is produced and its reachable states are computed, searching for erroneous executions. Model compilation can accelerate this analysis by generating code to explore the reachable states. This avoids the use of a fixed exploration tool involving ...

متن کامل

Towards Certified Slicing

Slicing is a widely-used technique with applications in e.g. compiler technology and software security. Thus verification of algorithms in these areas is often based on the correctness of slicing, which should ideally be proven independent of concrete programming languages and with the help of well-known verifying techniques such as proof assistants. As a first step in this direction, this cont...

متن کامل

On the Robustness of Most Probable Explanations

In Bayesian networks, a Most Probable Explanation (MPE) is a complete variable instantiation with the highest probability given the current evidence. In this paper, we discuss the problem of finding robustness conditions of the MPE under single parameter changes. Specifically, we ask the question: How much change in a single network parameter can we afford to apply while keeping the MPE unchang...

متن کامل

Towards Automating Airspace management

Military airspace is increasingly crowded with traditional aircraft competing with new loitering munitions and UAVs. Managing the airspace is therefore more challenging, requiring closer coordination among all the stakeholders. In this paper, we describe the motivation and design of a knowledgebased system that attempts to automate aspects of airspace management, including the detection and res...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Proceedings of the ... AAAI Conference on Artificial Intelligence

سال: 2022

ISSN: ['2159-5399', '2374-3468']

DOI: https://doi.org/10.1609/aaai.v36i6.20651